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Approx iaationt  in  Nuaerical  Analytla 
A  Report  on  a  Study 

Dr.  D.  H.  Lehaer  has  asked  us,  on  behalf  of  the  Coaaittee 
on  Arrangeaents ,  to  report  to  the  Aaerican  Matheaat ical  Spciety 
on  our  study  concerning  the  practical  approxiaat 1  on  of  functions. 
It  is  with  soae  eabarr assnent  that  we  undertake  to  coaply  with 
this  request.  Ours  is  not  a  theoretical  research  study,  but 
rather  a  practical  one  of  a  developmental  nature  in  which  only 
very  eleaentary  mathematics  has  been  employed.  Our  principal 
tools  have  been  the  laborious  use  of  the  desk  calculator,  and 
the  occasional  use  of  a  little  imagination. 

The  Nature  and  Purpose  of  the  Study; 

The  introduction  of  the  high  speed  digital  computing 
machine  makes  it  desirable  for  the  numerical  analyst  to  acquire 
a  fresh  outlook  on  the  problem  of  what  might  be  called  the 
nuaerical  representation  of  a  function.  In  olden  days,  when 
the  principal  instrument  of  calculation  was  the  pencil  attached 
to  a  human  being,  the  conventional  table  equipped  with  differences 
or  the  graph  that  could  be  read  by  eye  were  reasonable  means  of 
representing  a  function  numerically.  The  high  speed  digital 
computing  machine,  however,  has  quite  different  needs  from  those 
of  the  human  computer.  In  the  first  place,  the  digital  computing 
machine  can't  read  books,  charts,  and  graphs.  All  of  the  numerical 
information  it  has  access  to  must  either  be  stored  in  its  memory, 
which  may  be  quite  limited,  or  be  fed  into  its  memory  as  required. 
On  the  other  hand,  the  digital  computing  machine  can  do  vast 
quantities  of  simple  arithmetic  very  quickly  and  efficiently. 
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For  these  reasons,  an  obvious  aeans  of  functional  representation 
for  the  Machine  is  that  of  using  coapact  analytical  approxiaotions 
that  can  be  evaluated  easily  in  terms  of  basic  aachine  operations. 

It  was  quite  apparent  that  a  great  deal  of  consideration 
would  be  given  to  the  subject  of  polynoaial  approximation,  and 
this  has  indeed  turned  out  to  be  the  case.  But  the  numerical 
analyst  will  be  severely  handicapped  if  he  liaits  hiaself  to  the 
use  of  polynoaial  foras  alone.  Rational  foras  are  at  tiaes  a 
Bust,  if  a  reasonably  siaple  representation  is  to  be  obtained. 

He  will  be  further  handicapped  if  he  does  not  incorporate  an 
occasional  square  root  or  logaritha  in  his  parametric  fora  when 
such  is  definitely  a  requirement. 

Thus,  the  aost  important  objective  of  our  study  was  that 
of  demonstrating  how  to  select  the  appropriate  type  of  parametric 
form  for  use  in  a  given  instance  of  approximation.  There  seemed 
to  be  only  one  means  of  accomplishing  this  desired  end.  Ne  would 
have  to  work  out  a  large  number  of  illustrative  examples,  and 
this  is  what  we  have  been  doing  for  a  number  of  years  now.  Some 
of  the  resulting  approximations  are  fortunately  quite  useful,  and  a 
number  of  these  have  seen  considerable  use  in  many  computing  in- 
s  tal 1  a  t ions . 

We  are  then,  concerned  with  the  problem  of  choice  of 
parametric  form,  with  the  problem  of  determining  the  coefficients 
in  the  parametric  fora,  with  the  problem  of  presenting  our  results 
in  such  a  form  that  they  will  be  readily  understood,  and  finally 
with  the  problem  of  communicating  the  experience  that  we  have 
gained  in  the  preparation  of  our  examples  to  the  people  who  could 


profit  by  this  experience. 
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Choice  of  Parametric  Fora: 

At  sttted  above,  the  problea  of  choice  of  paraaetric 
fora  it  one  that  can  only  effectively  be  discussed  in  teras  of 
concrete  exaaplet.  For  this  reason,  we  now  discuss  half  a  dozen 
such  exaaplet.  At  we  are  only  concerned  with  the  fora  of  the 
approxiaation  at  present,  the  laboriously  obtained  nuaerical 

constants  have  been  replaced  by  letters. 

wee 

Exaaple  (1)  The  Coaaon  Logarithmic  Function: 

To  better  than  .000035  over  1  ^  x  s  10, 

Xg  X  i  ♦  ciT^^  ♦  C3ri^  t  C5r^  .  V  * 

The  choice  of  form  here  was  governed  by  two  considerations.  In 
the  first  place,  it  seemed  apparent  that  a  simple  polynomial 
form  could  not  do  the  Job  very  efficiently,  and  hence  a  rational 
form  was  indicated.  Secondly,  individual  teras  of  the  selected 
rational  fora  were  chosen  to  have  the  property  filO/x)  >  -Y^x) 
so  that  the  fora  would  mirror  an  important  property  of  the 
logarithmic  function.  As  a  consequence  of  this  later  consider¬ 
ation,  the  parameters  c^  could  be  determined  solely  by  approxi¬ 
aation  over  the  reduced  interval  (1,  'VTTT. 

Exaaple  (2)  The  Gaussian  Error  Integral: 

To  better  than  .00002  over  0  -  x  -  oo  , 

A  polynomial  to  a  substantial  negative  power  has  been  found 
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efficlent  for  use  in  the  approximation  of  functions  over  (0,<=^), 
in  which  the  asymptotic  behavior  is  roughly  that  of  a  decaying 
exponential . 


Example  (3)  A  Bessel  Function: 


To  better  than  .00005  over  0  *  x  ^  oo  , 


2  3 

1  «■  a|X  4-  a2X  ♦  a^x 


/  1  ♦  b|X  4-  b2X^  4-  b3X  4  b^x 
The  choice  of  form  here  was  governed  by  the  asymptotic 


behavior,  e"  (x)  ^(27rx)  ,  of  the  function  as  x 


Example  (4)  A  Certain  Definite  Integral: 

To  better  than  .00015  over  0  *  z  ^ 

.  r  -  ,  g-  a.  i  hill _ ^ 

y„  Kl'(u)*  Tr-=ii^u)  — 


The  choice  of  form  here  was  governed  by  the  asymptotic  behavior 
N(z)^z~^as  z  — e  oo .  This  integral  appears  in  a  paper  by 
G.  N.  Ward  entitled  'The  Approximate  External  and  Internal  Flow 
Past  a  Quasi-Cylindr ical  Tube  Moving  at  Supersonic  Speeds.'  A 
brief  table  of  N(z)  is  contained  in  this  paper.  Me  take  this 
opportunity  to  thank  Dr.  E.  T.  Goodwin  of  the  Nati>onal  Physical 
Laboratory,  Teddington,  Middlesex  and  his  associates  for  re- 
tabulating  N(z)  to  9D  over  (0,  <*«)  for  our  use  in  this  project. 


Example  (5)  The  Offset  Circle  Probability  Function  q(R,x): 

To  better  than  1)0014  over  -<><»*  x  ^  oo  , 

q(l.x)  - 

The  choice  of  fora  here  was  governed  by  the  fact  that  the  function 
approximated  is  an  even  function  of  x  and  by  the  further 


e  ^  I^i/xl/d/i  1  -  a  (l4b2X^4b4X^f  b^jf^)  ^  . 


consideration  already  stated  in  Exaeple  (2).  The  q(R,x) 
function  hat  been  finely  tabulated  to  60  by  the  Joint  effort 
of  NBS  INA  and  RAND. 

Exaaiple  (6)  A  Scoring  Caaera  Data  Reduction  Foraula: 

To  about  as  good  as  the  data  in  the  case  studied, 

d(r)  s  1«"  9  i  *0  ■»  *  «4'~^  . 

1  -  b2r^ 

Here  r  =  r(6)  is  an  empirically  deterained  function  relating 
the  angle  8  at  which  a  ray  enters  the  caaera  to  the  aeasuied 
distance  r  on  the  film  of  the  image  froa  the  origin  deteraihed 
by  the  intersection  of  the  optical  axis  of  the  lens  system  with 
the  surface  of  the  film.  The  choice  of  the  approximating  fora 
was  governed  by  the  fact  that  d(r)  must  matheaat ical ly  be  con¬ 
sidered  an  even  function  of  r,  and  by  the  further  fact  that  the 
singularity  Introduced  by  tan  8  should  be  properly  mirrored 
in  the  chosen  form.  The  problem  was  submitted  to  ut  by 

Mr.  John  Lowe  of  the  Douglas  Aircraft  Company. 

•  we 

While  the  above  examples  may  give  some  interesting  clues 
to  the  reader,  they  may  also  give  an  unfortunate  impression  that 
the  problem  of  choice  of  form  is  a  s impler affair  than  it  actually 
is.  It  takes  quite  a  bit  of  experience  in  the  approximation  of 
functions  before  one  gets  a  feeling  for  just  what  aspects  of  the 
function  to  be  approximated  should  be  mirrored  in  the  choien  form. 
Even  given  the  required  experience,  there  will  be  times  when  a 
form  appears  to  be  chosen  properly,  and  yet  is  incapable  of 
doing  the  job  required  of  it.  But  this  is  all  a  part  of  the 
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gaae,  and  should  not  dtttr  the  practicel  auatrical  analyst  from 
thinking  aore  constructively  about  the  problea  of  choice  of  fora. 
The  Fora  (15)  Sheets; 

In  order  to  aake  certain  concrete  results  of  our  study 

/ 

available,  «e  began  in  the  early  days  of-our  study,  to  prepare 
individual  sheets  [^ij  each  containing  data  pertinent  to  an 
interesting  approxiaation  and  including  a  carefully  drawn  error 
curve.  These  are  the  so-called  Fora  (15)  sheets.  To  date,  soae 
seventy  such  sheets  have  been  prepared,  and  soae  five  hundred 
binders  of  these  sheets  have  been  distributed  to  aeabers  of  the 
coaputing  fraternity.  Only  one  foraal  notice  concerning  the 
existence  of  this  binder  has  been  aade,  and  this  was  aade  quite 
recently. 

In  addition  to  preparation  of  the  Fora  (15)  sheets,  we 
have  also  initiated  a  cuaulative  publication  of  approxiaat ions 
in  the  journal  MTAC,  with  Dr.  Lehaer's  blessing.  At  this  writing, 
forty  five  new  approxiaat ions  have  been  subaitted  to  MTAC  for 
publication,  and  twelve  of  these  iteas  [^3^  have  already  appeared 
in  print. 

Reports  on  Methods; 

To  date  we  have  prepared  very  little  written  aeteriel 
about  aethods  of  approxiaation  in  n  fora  suitable  for  distribution. 
Quite  naturally,  a  certein  aaount  of  eleaentary  technique  hat  been 
developed  for  use  in  carrying  out  the  fitting  of  the  paraaetrie 
foras  to  the  functions  in  question.  These  techniques  are  of  an 
entirely  numerical  nature.  By  this  we  aean  that,  as  a  first  step, 
we  require  a  numerical  table  of  the  function  to  be  approxiaated. 
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Tlien,  we  deteraine  the  nuaerical  values  of  the  pareaetert  in 
the  paraaetric  fora  by  a  process  of  trial  and  error  that  involves 
the  nuaerical  solution  of  equations,  graphing  of  error  curves,  etc. 
One  preliainary  paper  [^4^  ,  written  while  our  study  was  in  a  very 
early  stage,  gives  soae  idea  of  our  methods.  A  recent  effort 
of  ours  gives  a  little  further  information.  Ve  shall  devote  a 
few  words  to  this  latter  report.  Reference  [^5^  has  the  rather 
flippant  title  'The  Incomplete  Approximator*  (In  six  fits).  This 
little  effort  started  its  life  as  a  film  strip.  Ve  prepared  a 
sequence  of  one  hundred  thirteen  large  inked  drawings,  and  hod 
these  photographed  ic  sequence  on  a  continuous  strip  of  movie 
film.  This  film  strip  was  presented  to  the  June  12.  1953  meet¬ 
ing  of  the  Digital  Computers  Association.  Later,  the  original 
drawings  were  revised,  photographically  reduced  in  size  and 
the  resulting  photos  mounted  on  sheets  of  paper  together  with  a 
type-written  running  commentary.  Thus  the  finished  report 
resembled  a  comic  book  in  appearance,  and  we  were  quite  pleased 
with  the  admittedly  crude  'cartoon  strip'  technique.  A  limited 
number  of  copies  of  this  report  were  offset  printed,  and  distributed 
to  members  of  the  Digital  Computers  Association. 

Preparation  of  an  Omnibus  Report; 

At  present  we  are  working  on  the  preparation  of  an  omnibus 
report  which  will  serve  to  present  our  thoughts  to  date'on  the 
subject  of  practical  approximation.  The  material  contained  in 

our  binder  of  approximations  will  be  included  as  an  appendix  to 

/ 

thi srepor t . 

It  is  our  present  plan  to  prepare  the  text  of  this  report 


in  cartoon  strip  style.  The  result  will  be  soacwbut  of  a 
novelty  but  should  serve  to  put  across  what  we  have  to  say  in 
aa  enjoyable  and  palatable  wanner.  At  present,  we  are  working 
on  the  developwent  of  the  cartoon  strip  technique  as  applied  to  our 
particular  needs.  We  are  trying  to  learn  to  convey  ideas  of  is- 
portance  in  as  efficient  a  wanner  as  possible.  Towards  this  end, 
we  have  been  giving  sowe  consideration  to  the  idea  of  trying 
to  describe  the  actual  thinking  process  that  should  take  place 
in  the  reader's  wind.  We  hope  in  this  fashion,  to  transfer 
sone  of  the  'frawe  of  wind*  that  a  person  should  have  in  attack¬ 
ing  a  practical  problew  in  approxiwation. 


The  RAND  Corporation 
1700  Main  Street 
Santa  Monica,  California 


Mr.  Cecil  Hastings,  Jr. 
Mrs.  David  K.  Hayward 
Mr.  Jawes  P.  Noag,  Jr. 
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